Search for: All records

We study the problem of extracting biometric informa- tion of individuals by looking at shadows of objects cast on diffuse surfaces. We show that the biometric information leakage from shadows can be sufficient for reliable identity inference under representative scenarios via a maximum like- lihood analysis. We then develop a learning-based method that demonstrates this phenomenon in real settings, exploit- ing the subtle cues in the shadows that are the source of the leakage without requiring any labeled real data. In par- ticular, our approach relies on building synthetic scenes composed of 3D face models obtained from a single photo- graph of each identity. We transfer what we learn from the synthetic data to the real data using domain adaptation in a completely unsupervised way. Our model is able to general- ize well to the real domain and is robust to several variations in the scenes. We report high classification accuracies in an identity classification task that takes place in a scene with unknown geometry and occluding objects. 

We present a method to map 2D image observations of a scene to a persistent 3D scene representation, enabling novel view synthesis and disentangled representation of the movable and immovable components of the scene. Motivated by the bird’s-eye-view (BEV) representation commonly used in vision and robotics, we propose conditional neural groundplans, ground-aligned 2D feature grids, as persistent and memory-efficient scene representations. Our method is trained self-supervised from unlabeled multi-view observations using differentiable rendering, and learns to complete geometry and appearance of occluded regions. In addition, we show that we can leverage multi-view videos at training time to learn to separately reconstruct static and movable components of the scene from a single image at test time. The ability to separately reconstruct movable objects enables a variety of downstream tasks using simple heuristics, such as extraction of object-centric 3D representations, novel view synthesis, instance-level segmentation, 3D bounding box prediction, and scene editing. This highlights the value of neural groundplans as a backbone for efficient 3D scene understanding models. 

High-resolution simulations can deliver great visual quality, but they are often limited by available memory, especially on GPUs. We present a compiler for physical simulation that can achieve both high performance and significantly reduced memory costs, by enabling flexible and aggressive quantization. Low-precision ("quantized") numerical data types are used and packed to represent simulation states, leading to reduced memory space and bandwidth consumption. Quantized simulation allows higher resolution simulation with less memory, which is especially attractive on GPUs. Implementing a quantized simulator that has high performance and packs the data tightly for aggressive storage reduction would be extremely labor-intensive and error-prone using a traditional programming language. To make the creation of quantized simulation practical, we have developed a new set of language abstractions and a compilation system. A suite of tailored domain-specific optimizations ensure quantized simulators often run as fast as the full-precision simulators, despite the overhead of encoding-decoding the packed quantized data types. Our programming language and compiler, based on Taichi , allow developers to effortlessly switch between different full-precision and quantized simulators, to explore the full design space of quantization schemes, and ultimately to achieve a good balance between space and precision. The creation of quantized simulation with our system has large benefits in terms of memory consumption and performance, on a variety of hardware, from mobile devices to workstations with high-end GPUs. We can simulate with levels of resolution that were previously only achievable on systems with much more memory, such as multiple GPUs. For example, on a single GPU, we can simulate a Game of Life with 20 billion cells (8× compression per pixel), an Eulerian fluid system with 421 million active voxels (1.6× compression per voxel), and a hybrid Eulerian-Lagrangian elastic object simulation with 235 million particles (1.7× compression per particle). At the same time, quantized simulations create physically plausible results. Our quantization techniques are complementary to existing acceleration approaches of physical simulation: they can be used in combination with these existing approaches, such as sparse data structures, for even higher scalability and performance. 

In April 2019, the Event Horizon Telescope (EHT) Collaboration reported the first-ever event-horizon-scale images of a black hole, resolving the central compact radio source in the giant elliptical galaxy M 87. These images reveal a ring with a southerly brightness distribution and a diameter of ∼42 μas, consistent with the predicted size and shape of a shadow produced by the gravitationally lensed emission around a supermassive black hole. These results were obtained as part of the April 2017 EHT observation campaign, using a global very long baseline interferometric radio array operating at a wavelength of 1.3 mm. Here, we present results based on the second EHT observing campaign, taking place in April 2018 with an improved array, wider frequency coverage, and increased bandwidth. In particular, the additional baselines provided by the Greenland telescope improved the coverage of the array. Multiyear EHT observations provide independent snapshots of the horizon-scale emission, allowing us to confirm the persistence, size, and shape of the black hole shadow, and constrain the intrinsic structural variability of the accretion flow. We have confirmed the presence of an asymmetric ring structure, brighter in the southwest, with a median diameter of 43.3_−3.1^+1.5 μas. The diameter of the 2018 ring is remarkably consistent with the diameter obtained from the previous 2017 observations. On the other hand, the position angle of the brightness asymmetry in 2018 is shifted by about 30° relative to 2017. The perennial persistence of the ring and its diameter robustly support the interpretation that the ring is formed by lensed emission surrounding a Kerr black hole with a mass ∼6.5 × 10⁹ M_⊙. The significant change in the ring brightness asymmetry implies a spin axis that is more consistent with the position angle of the large-scale jet.

 

In 2017 the Event Horizon Telescope (EHT) observed the supermassive black hole at the center of the Milky Way, Sagittarius A* (Sgr A*), at a frequency of 228.1 GHz (λ= 1.3 mm). The fundamental physics tests that even a single pulsar orbiting Sgr A* would enable motivate searching for pulsars in EHT data sets. The high observing frequency means that pulsars—which typically exhibit steep emission spectra—are expected to be very faint. However, it also negates pulse scattering, an effect that could hinder pulsar detections in the Galactic center. Additionally, magnetars or a secondary inverse Compton emission could be stronger at millimeter wavelengths than at lower frequencies. We present a search for pulsars close to Sgr A* using the data from the three most sensitive stations in the EHT 2017 campaign: the Atacama Large Millimeter/submillimeter Array, the Large Millimeter Telescope, and the IRAM 30 m Telescope. We apply three detection methods based on Fourier-domain analysis, the fast folding algorithm, and single-pulse searches targeting both pulsars and burst-like transient emission. We use the simultaneity of the observations to confirm potential candidates. No new pulsars or significant bursts were found. Being the first pulsar search ever carried out at such high radio frequencies, we detail our analysis methods and give a detailed estimation of the sensitivity of the search. We conclude that the EHT 2017 observations are only sensitive to a small fraction (≲2.2%) of the pulsars that may exist close to Sgr A*, motivating further searches for fainter pulsars in the region.

 

Event Horizon Telescope (EHT) observations have revealed a bright ring of emission around the supermassive black hole at the center of the M87 galaxy. EHT images in linear polarization have further identified a coherent spiral pattern around the black hole, produced from ordered magnetic fields threading the emitting plasma. Here we present the first analysis of circular polarization using EHT data, acquired in 2017, which can potentially provide additional insights into the magnetic fields and plasma composition near the black hole. Interferometric closure quantities provide convincing evidence for the presence of circularly polarized emission on event-horizon scales. We produce images of the circular polarization using both traditional and newly developed methods. All methods find a moderate level of resolved circular polarization across the image (〈∣v∣〉 < 3.7%), consistent with the low image-integrated circular polarization fraction measured by the Atacama Large Millimeter/submillimeter Array (∣v_int∣ < 1%). Despite this broad agreement, the methods show substantial variation in the morphology of the circularly polarized emission, indicating that our conclusions are strongly dependent on the imaging assumptions because of the limited baseline coverage, uncertain telescope gain calibration, and weakly polarized signal. We include this upper limit in an updated comparison to general relativistic magnetohydrodynamic simulation models. This analysis reinforces the previously reported preference for magnetically arrested accretion flow models. We find that most simulations naturally produce a low level of circular polarization consistent with our upper limit and that Faraday conversion is likely the dominant production mechanism for circular polarization at 230 GHz in M87*.